CONTROL OF A SYSTEM FOR PROCESSING A STREAM OF INFORMATION 

BASED ON INFORMATION CONTENT 

FIELD OF THE INVENTION 

This invention relates to the control of information processing, e.g. a television. More 
5 specifically, the invention relates to control of a television, and/or other related devices, by signals 
p received over one or more connections to communication connection, like a network. 

in 

g BACKGROUND OF THE INVENTION 

ii 

!□ Television displays a stream of program segments, sometimes including commercial 

63 

Q messages, to users/viewers. This information is received by the television by any number of well 
'fO known transmission methods including: direct broadcast, cable, fiber optics, etc. 

In some of the prior art, some control of the programming is given to the user. For 
example, there are "pay per view" features in certain cable television networks that provide a 
particular program to a television viewer only if the viewer agrees to pay for the program, either 
as a periodic subscription or as a per use payment. Certain subscription services provide specific 
1 5 types of programming (e.g. nature or children's programming) or programming with a limited 
number or no commercial messages. 

In certain information processing systems, e.g., a video recorder, devices can be 
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controlled by characteristics of the signal itself. For example, a dark screen occurring in a 
television program being recorded indicates that a commercial is about to begin (end) and that the 
record speed of the video recorder should be slowed down (sped up). 

However, in much of the prior art, there is a limited amount of automatic control that the 
user has over his television based on the content of the information being received by the 
television. Therefore, there is a need for an improved way to control the content outputted by a 
television (either to the television monitor and/or to an attached processing device like a video 
recorder) in standard television programming that is based on the content of the information that 
is being received by/sent to the television. 

SUMMARY OF THE INVENTION 

An object of this invention is to provide a system and method for generating an output 
function based on the content of a stream of information. 

An object of this invention is an improved system and method for controlling the 
information that is outputted from a television. 

An object of this invention is a system and method that uses content of information to 
select specific information to be outputted from a television. 

An object of this invention is a system and method that uses content of information to 
prevent specific information (e.g. commercials) from being outputted from a television. 

In a first aspect of the present invention, a segment announcing system is disclosed that 
contains one or more segment announcement receivers that receive one or more announcements 
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over a network connection and/or other communication connection. The announcements 
contain descriptions about the content of broadcast information (content stream), e.g., being 
broadcast to a television. The segment announcement receivers have one or more control 
outputs to perform one or more functions. For example, one of the control outputs can be 
connected to one or more televisions and/or one or more television processing devices (like a 
video recorder). The type of control used depends on the description of the content stream 
being broadcast/received and, in a preferred embodiment, preferences of the user. 

The announcements have one or more headers that have content descriptions, e.g., one or 
more categories of content describing a segment of broadcast information (content stream). 
Descriptions of the segment/content stream, e.g., the start and/or end time (and/or duration) of 
the segment, is also included in the network message. In one preferred embodiment, certain 
types of categories of content, e.g. commercials, produce certain types of control functions, e.g. 
sound muting or video recorder pause. In other preferred embodiments, after one or more of 
these content categories is matched to a filter record in the segment announcement receiver, an 
appropriate control output associated with the respective content category is activated and the 
television (segment announcement receiver) is controlled the selected way, e.g. during the 
processing of the information (content stream). 

In one preferred embodiment a service is provided by a server on the network, called a 
segment announcer. The server has a process that composes the network messages and transmits 
them to all or to selected (e.g. those paying for the service) segment announcement receivers 
connected on the network. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is a block diagram of the segment announcer system showing one or more 

segment announcers, a communication connection, and one or more connected segment 

announcement receivers, e.g. a video recorder or a television. 

Figure 2 is a block diagram showing alternative preferred embodiments of the segment 
announcer. 

Figure 3 is a block diagram of an example announcement. 

Figure 4 is a block diagram of an example filter record in a preferred embodiment of the 
segment announcement receiver. 

Figure 5 is a flow chart of a process operating within the segment announcement receiver 
that activates/deactivates the control output(s) when certain packet information in the network 
message is received. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

OF THE INVENTION 

Figure 1 is a block diagram of the segment announcer system 100 showing one or more 
segment announcers 1 10, a communication connection 120, and one or more connected segment 
announcement receivers 150, e.g. a video recorder or a television. 

The segment announcer 1 10 is a computer workstation, e.g. an IBM laptop personal 
computer, that is typically used by a person 1 1 1 or group of people 1 1 1 to enter descriptive 
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information about the content of one or more content streams 1 12 they 1 1 1 are perceiving. The 
content streams 1 12 can include any type of information as follows: a television program, a radio 
program, a corporate information session, a commercial, a live sporting event, etc. 

For example, the person 1 1 1 can represent a special interest group that is viewing the 
content of a television program being broadcast in real time or alternatively to be broadcast using 
tape at a later time. This person would provide descriptive information, like a rating, based on his 
organization's viewpoint. For instance, an animal rights group 1 1 1 would input descriptive 
information about the treatment of certain animals on a nature television program to be aired later 
in the day. 

In an alternative example, the person 1 1 1 could be a spectator at a live sporting event that 
has interest in a specific player's performance. When that player does something noteworthy, 
descriptive information (250 below) about the event is inputted. 

In another example, a group of people 1 1 1 will monitor a television (radio) program and 
indicate when a commercial begins or ends. If one of the people 1 1 1 is inattentive, one of the 
others 1 1 1 will input the description 250 instead. 

In another preferred embodiment, the segment announcer 109 is a central data bank of 
descriptive information 250 about the content of various content streams 1 12 currently being 
transmitted and/or to be transmitted in the future. These descriptions can be submitted in real 
time (e.g., as describe about) over communication connections 120 like the Internet and/or can be 
provided from various interest groups as stored data files. For example, the owner of the 
segment announcer 110 would buy comments, rating, etc. from various movie critics and provide 
them to the segment announcement receivers 150 as they view the movie. Certain religious or 
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political groups 1 1 1 might also provide descriptions (comments, ratings, etc.) about the 
information as well. Payments could be made for the descriptions 250, either by the owner of the 
segment announcer or by the groups 1 1 1 seeking to have their descriptions 250 transmitted to the 
segment announcement receivers 150. The users 155 of the segment announcement receivers 
5 1 50 might also pay for the transmission of these descriptions 250. 

Other examples of descriptions 250 include: a rating, a category, a comment, a content 
description, a segment type, a program part, a program source, a review, a statistic, and a 
character name. 

Q The descriptions 250 of the content are transmitted by announcement 1 1 5 over the 

Iff communication link 120 to the segment announcement receivers 150. The announcement 1 15 is 

further described in Figure 3. 
y This content information is transmitted to one or more segment announcement receivers 

O 150 over one or more well known transmission modes/connections 120. While Figure 1 shows 

□ the mode as a network 120, other transmissions modes like multicast packets over the Internet, 

Ui 

fj/f radio broadcast, cable networks, Digital Video Broadcast data stream (DVB), vertical blanking 
interval (for analog television), satellite, and telephone, are envisioned without loss of generality. 

The segment announcement receivers 150 receive the announcements 115. The segment 
announcement receivers 150 are any signal processing device that processes the signal being 
transmitted over the communication connection 120. In one preferred embodiment, the 

20 communication connection is a television broadcast (e.g., off air or cable) and the segment 

announcement receiver is a television 1 50 and/or video recorder (1 50, 1 60). Other examples of a 
segment announcement receiver 1 50 include: a radio 163, a deferred use device (like a tape delay 
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165 or video recorder 160), a closed circuit television 162, and a computer 161 . These devices 
(generally 150) have known communication interfaces 152 appropriate for the communication 
mode 120. For example, the interface 1 52 for the Internet might be a modem or network 
interface card and the interface 152 for a radio would be a tuner/demodulator circuit. 

The announcements 1 15 are processed by the segment announcement receivers 150 to 
cause a function 170 to occur. Typically, the function 170 is performed by a particular known 
control device 180 and the function controls some aspect of the segment announcement receiver 
150. For example, if the descriptive information indicates that the content stream is a 
commercial, a function 170 would be performed to adjust the sound control (stop record) 180 of 
the television (video recorder) 150 to mute (stop) 170 at the beginning of the commercial and to 
restore the sound (resume recording) 170 at the end of the commercial. Other examples of 
functions 170 using known controls 180 are: a message display, a mute, a stop record, a play, a 
start record, a screen blanking, and an alarm. 

In some preferred embodiments, the segment announcement receivers 150 have data 
structures 400 and processes 500 that are used to automatically control the function of the 
segment announcement receivers 150 based on the one or more of the content descriptions of 
one or more of the content streams. See the description below. 

Figure 2 is a block diagram showing alternative preferred embodiments of the segment 
announcer 1 10. Features in common with those in Figure 1 have the same designation numbers 
and description as above. The segment announcers 1 10 has a communication connector 205 
appropriate to the communication connection 120 used. For example, if the communication 
connection 120 is the Internet, the communication connector 205 is a modem and/or a network 
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interface card. If the communication connection 120 is a radio or television over land broadcast 
signal, the communication connector 205 is a well known transmitter. 

As stated before, the person/group 1 1 1 perceives (views, listens to) the content stream 112 
and enters descriptive information 250 into the segment announcer 1 10. 

In an alternative embodiment, the descriptions 250 are entered automatically. For 
example, the descriptions 250 about the various content streams 112 can be sent by a 
communications link 220, e.g. the Internet and/or a satellite connection that is fed as a data signal 
to the segment announcer. In some cases these descriptions 250 are already associated with the 
content streams, e.g., "Nielson ratings" and programming descriptions from various (television) 
program subscription services. Other devices can be used to automatically provide descriptions 
250 about the content stream 112, e.g., an image brightness detection device, for detecting 
brightness changes at commercial boundaries, and/or other video image process devices that 
queries images by image content (see QBIC, an IBM video processor). 

The system can be based on a combination of human monitors or electronic means of 
determining when program segments start and end. More than one monitor (human or 
electronic) may be used for each program, the inputs from the monitors can be weighted in 
various means based on the reliability of the monitors (i.e., if there are three monitors of one 
program and two of them say the program has resumed, the system could Vote 1 that the program 
has resumed. It could discount input from monitors 1 1 1 who prove to be unreliable or slow.) 
Servers 1 10 can listen to input from several monitors 1 1 1 and produce a more homogenized 
(perhaps more reliable) source of announcements 115. 

In one embodiment, a service provided by the segment announcer 1 09 can naturally be 
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combined with a TV schedule application, to allow applications to 'record the Simpsons when it 
comes on 1 170, eliminating commercials 170 that come on before, during and after the broadcast. 
In this embodiment, more than one announcement 115 might be used, i.e., turn on the recorder 
160 when the show comes on, stop recording (170, 180) the commercials, and start recording 
(170, 180) when the show comes back on. 

The service can also allow content within a single program to be identified, such as 'turn it 
on when the weather forecast is on the local news', or 'record Andy Rooney's segment of 60 
Minutes'. 

In one preferred embodiment, the segment announcer 110 (perhaps using HTTP) 
associates a Content Stream ID (322 below) with a specific broadcast (i.e. 'Star Trek on channel 
1 1 from New York City' as opposed to a possibly different 'StarTrek' from New Haven, CT, or 
f ABC News on the East Coast feed' as opposed to the West Coast feed.) 

Each announcement 1 15 is contained in a separate multicast UDP packet. Each packet 
contains the id of the program, the id of the monitor sending the report, the time of the event, and 
the type of event. This allows other information (such as commentary, copyright information, 
lyrics, captions and/or cue points to be included. Absolute time stamps are used (rather than the 
'delta time 1 used in MIDI) because messages may be missed and because messages may be 
delayed. 

Because absolute time stamps can be used as part of the description 250, the 
announcements (event messages) 115 for a program may be recorded for later use. If a program 
is recorded in its entirety the record of the events can be used in later viewing to fast forward, or 
used for editing purposes. 
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Figure 3, Segment Announcement Message, or announcement, 115 

A segment announcement message 1 15 is used to communicate one or more pieces of 
information about what is going on in a segment (instant or interval) of the content stream 1 12. 
This message typically comprises three parts: 1) Announcement Identifiers 310, 2) Segment 
Identifiers 320 and Segment Content Information 350. 

In a preferred embodiment, the Announcement Identifier comprises the following fields: 
1) the Message Tag 31 1, which identifies this message as a Segment Announcement Message; the 
Announcer Id 312 which indicates who is issuing the announcement (the origin and/or source of 
the announcement, e.g. "Greenpeace"); and optional Authentication and or Encryption Data 313, 
which can be used to verify that the message came from the specified source and can prevent 
unauthorized use of the information. 

The Segment Identifier section 320 has information identifying specific content in a 
segment or portion of the content steam 1 12 among all the hours of television being broadcast, 
and comprises: the Time 321, the time of day at which the event described in this announcement 
115 was transmitted in the content stream 1 12; the Program Source Id 322, which indicates 
which broadcast or transmission this refers to (i.e., WCBS, Channel 2 in New York City, or CNN 
Airport Channel, East Coast Feed), and optionally Position Within Frame Info 323, which 
indicates what point or area within a video frame to which the announcement 115 applies. 
Together the time 321 and Content Stream ID 322, and position (e.g. within frame) 323 identify 
what segment or portion of the content stream to which the announcement 1 15 is message 
applies. 

The Segment Content Information 350 describes the event in the segment (content stream 
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1 12) and comprises: the Announcement Type Identifier 35 1 which indicates what sort of 
information this event describes. The Fixed Length Announcement Content 352 and the 
Variable Length Announcement Content 353 fields are optional and contain the additional 
description. For example, an Announcement Type of 'Start of Commercial 1 or 'End of 
Commercial 1 would require no Announcement Content fields. A 'Rating* type message could 
contain an Announcement Content of 'G', 'PG\ *R', 'X' or *XXX\ A 'Comment' type message 
could contain a long text message or digital audio data. 

Figure 4 is a block diagram of an example a filter record 400 in a preferred embodiment 
of the segment announcement receiver. 

A preferred embodiment uses a table 400 as the basis of the Announcement Receiver's 
process for handling messages. The table contains rows (as an example, typically 450-454), 
which constitute the user's wishes for how Announcement Messages 115 should be processed. If 
a row is considered to 'match' the Announcement Message 1 15, an 'action' 425 specified in the 
record is carried out. 

Each row typically contains 5 fields: 1) the Announcement Type Field 405, 2) the 
Announcement Content Field 410, 3) the Content Stream Id Field 415, 4) the Announcer Id Field 
420 and 5) the Action Field 425. Each of the first four fields can contain either a value that 
matches the corresponding field in an Announcement Message 1 15, or an 'Any' indication. The 
Content Stream Id Field 415 may also contain a 'Currently Selected Channel' value that is 
considered to be a match if the message's Content Stream Id matches the channel that the user 
(of the VCR) is currently watching. An 'Any' value is always considered a match. 

The Action Field 425 contains a list of functions 1 70 for the receiver to perform in case of 
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a match. These functions 170 are performed by the known control devices 180 and could 
include: turning the sound on or off, turning the picture on or off, changing the selected TV 
channel, displaying text on a TV or computer screen, sounding an alarm, starting or stopping 
recording on a VCR, 

Figure 5 is a flow chart of a process 500 operating within the segment announcement 
receiver 150 that activates/deactivates the control output(s) 180 when certain packet information 
in the network message (announcement 1 15) is received. 

The process that is the heart of the Announcement Receiver is a loop that: 1) waits for the 
next announcement 1 15 to arrive 505, 2) finds any rows of the Filter Table 400 that match the 
announcement 510-525 and 3) perform the actions associated with each matching record 530. 

After receiving the announcement 505 (perhaps with a Socket recv() function), the 
programs sets a pointer to the first row in the Filter Table 400 and checks to see of the first four 
fields in the table 405-420 match the corresponding fields in the announcement 115. If they 
match, the Action Field 425 is examined and each of the actions is performed 530. Whether the 
first record matches or not, if there are more records to test the pointer is incremented to point to 
the next record and the next record is checked for a match, and so on. 

The matching process 515-525 consists of the relevant fields in the message's 
Announcement Identifiers 310, Segment Identifiers 320 and Segment Content Information 350 
matches the corresponding fields in the Filter Table Record 450-454. If the corresponding fields 
do not actually match, but the filter record contains an 'Any* indication, then the program 
proceeds as if the fields actually matched. In the case of the Content Stream Id Field 41 5 and 
322, if the filter record field is 'Currently Selected Channel 1 then the fields are considered a match 
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if the announcement's field matches the channel that the TV or VCR is currently tuned to. 

The announcement message 1 15 has an event time 321 associated with it. For most real 
time applications, the announcement will be received shortly after the event in the content stream 
has occurred, (i.e., the announcement of the beginning of the commercial won't get to you until 
slightly after the commercial is showing on your TV. This is because of the time it takes to detect 
the commercial and the delay in transmission of the announcement.) In this case the actions 425 
are executed as soon as the announcement has been matched 515-525, which is usually good 
enough. In some situations, announcements 1 15 can be sent before the time of the event in the 
content stream 1 12, in which case the execution of the action 425 is delayed. 

In some situations the display of the content stream can be delayed, by later video tape 
replay, or by short term electronic delay in the TV. This allows the system to correct the delay in 
detecting and transmitting announcements by performing the action 425 at the correct time 
relative to the display of the content stream 1 12. 
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